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ABSTRACT 

Objectives: Intention to treat (ITT) is an analytic 
strategy for reducing potential bias in treatment effects 
arising from missing data in randomised controlled 
trials (RCTs). Currently, no universally accepted 
definition of ITT exists, although many researchers 
consider it to require either no attrition or a strategy to 
handle missing data. Using the reports of a large pool 
of RCTs, we examined discrepancies between the types 
of analyses that alcohol pharmacotherapy researchers 
stated they used versus those they actually used. We 
also examined the linkage between analytic strategy (ie, 
ITT or not) and how missing data on outcomes were 
handled (if at all), and whether data analytic and 
missing data strategies have changed over time. 
Design: Descriptive statistics were generated for 
reported and actual data analytic strategy and for 
missing data strategy. In addition, generalised linear 
models determined changes over time in the use of 
ITT analyses and missing data strategies. 
Participants: 165 RCTs of pharmacotherapy for 
alcohol use disorders. 

Results: Of the 165 studies, 74 reported using an ITT 
strategy. However, less than 40% of the studies 
actually conducted ITT according to the rigorous 
definition above. Whereas no change in the use of ITT 
analyses over time was found, censored (last follow-up 
completed) and imputed missing data strategies have 
increased over time, while analyses of data only for the 
sample actually followed have decreased. 
Conclusions: Discrepancies in reporting versus 
actually conducting ITT analyses were found in this 
body of RCTs. Lack of clarity regarding the missing 
data strategy used was common. Consensus on a 
definition of ITT is important for an adequate 
understanding of research findings. Clearer reporting 
standards for analyses and the handling of missing 
data in pharmacotherapy trials and other intervention 
studies are needed. 
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In pharmacotherapy trials, participants typically 
are randomly assigned to a pharmacotherapy or 
a placebo (control) condition. With a sufficient 
sample size, randomisation usually produces 
separate groups without systematic differences by 
equalising factors within groups that may be 



Strengths and limitations of this study 



First study to examine intention-to-treat (ITT) 
practices in randomised controlled trials (RCTs) 
of pharmacotherapy for alcohol misuse. 
Included a large body of studies in the analyses. 
Examined changes over time in data analytic and 
missing data strategies across nearly 40 years of 
scientific research. 

Findings important for improving reporting prac- 
tices in RCTs of pharmacotherapy trials for 
alcohol misuse. 

Descriptive analyses could not determine 
whether there is any relationship between ITT 
and effect sizes. 



associated with outcome (eg, motivation, age 
and gender). Under ideal circumstances, the 
randomisation process allows valid causal infer- 
ences to be made about the impact of the 
pharmacotherapy compared to the control con- 
dition. That is, one can be highly confident that 
any post-treatment differences in outcome are 
attributable to the impact of the medication 
itself and not to the pre-existing differences in 
the characteristics of the pharmacotherapy and 
placebo samples. However, when the randomisa- 
tion process is disrupted, either through treat- 
ment dropout and/or missing data on 
outcomes, or when the original sample as ran- 
domised is not the same sample analysed (ana- 
lysed N <randomised N), bias may be 
introduced that compromises the internal valid- 
ity of results. 1-4 

The intention-to-treat (ITT) analytic strat- 
egy is one solution for eliminating or redu- 
cing bias in treatment effects arising from 
missing outcome data in randomised con- 
trolled trials (RCTs). 1 2 Although no univer- 
sally accepted definition of ITT currently 
exists, the procedure nevertheless is 
endorsed in the Consolidated Standards of 
Reporting Trials (CONSORT). 5 " 7 One par- 
ticularly succinct definition of a 'true ITT' 8 
analysis is "once randomized, always 
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analyzed." 9 Under this definition, ITT involves the ana- 
lysis of all trial participants who were randomised, 
regardless of adherence to treatment protocol (eg, 
dropout/ withdrawal or protocol deviations). In other 
words, defined this way, ITT requires either no attrition 
or a strategy to handle missing data. 

ITT has several strengths, including (1) helping to 
preserve the integrity of the randomisation process (ie, 
groups are expected to be similar except for random 
variation and receipt of treatment/control condition) 
and (2) providing a more realistic estimate of average 
treatment effects in the 'real world' as it is the norm for 
some patients to drop out or not adhere to treatment. 1 
Both the points above address the issue of patient 
dropout, as analyses on only adherent patients are likely 
to lead to inflated estimates of treatment effects. 
Research has shown that adherent patients generally do 
better than non-adherent patients, regardless of treat- 
ment. 10 11 The more realistic estimates of treatment 
effects under conditions of routine care that are derived 
from ITT analyses have particular relevance for policy- 
makers and those interested in hypotheses of pragmatic 
('real world') importance. 

A variant of the ITT approach, what Polit and Gillespie 
(2010) term a 'modified ITT' analysis, maintains the 
conditions to which people were randomly assigned and 
attempts to follow-up all participants, regardless of their 
participation in the intervention. However, only those 
successfully followed are included in the analyses. With 
this modified approach, however, the balance in pre- 
existing characteristics across conditions sought through 
random assignment is less likely to hold. 

An alternative to ITT analysis, the per protocol analytic 
procedure (ie, analyses based on only 'adherent' partici- 
pants in randomised samples), has strengths as well and 
is of particular importance for hypotheses of an explana- 
tory nature. 12 The per protocol approach can range 
from analyses in which only those research participants 
who began treatment are included, to those in which 
only participants who received what was deemed a 'suffi- 
cient dose' of treatment are used, to those in which only 
participants who fully completed treatment are included 
(also referred to as a 'complete cases' approach; 2 ). 
Advocates of the per protocol approach assert that the 
analysis tests the true efficacy of the intervention when 
used as directed (ie, efficacy among those who are 
adherent and able to tolerate the treatment) . 

Since both the ITT and per protocol approaches to 
RCT analyses have their strengths, a possible strategy is 
to conduct an ITT analysis, with a per protocol sensitivity 
analysis to 'bracket' the likely effects under different 
conditions. Nevertheless, ITT analyses are considered 
the 'gold standard' and researchers frequently report 
the use of this procedure in the published literature, 
even in the absence of a consensual definition. 
Discrepancies can arise, however, between the types of 
analyses that researchers state in research reports that 
they conducted and what they actually did with respect 



to the use of a 'true' ITT analysis or some other proced- 
ure based on less than the full randomised sample. For 
example, in clinical trials in the nursing field, Polit and 
Gillespie (2009) found that for 10.5% of studies, 
researchers who stated they had used an ITT approach 
had actually conducted per protocol analyses. 

It is unknown to what degree ITT strategies are being 
employed in pharmacotherapy for alcohol use disorders 
(AUDs). One aim of this review was to determine if there 
are discrepancies between the types of analyses that 
researchers stated they used and those they actually used, 
based on information in reports of a large pool of RCTs of 
pharmacotherapy for AUDs published between 1970 and 
2009. The second aim was to describe the use of different 
missing data strategies in studies in which true and modi- 
fied ITT analyses were and were not conducted. The final 
aim was to determine whether the use of different data 
analytic approaches and certain types of missing data 
approaches (eg, multiple imputation) has increased over 
time while the use of others has decreased. 

METHODS 
Literature search 

As part of a larger project examining the efficacy of 
pharmacotherapies for AUDs and alcohol misuse, 13 we 
identified relevant RCTs via several searches of PubMed 
and PsycINFO conducted at different points over the 
past decade. Study inclusion criteria were (1) a focus on 
treating alcohol misuse or an AUD; (2) participants 
18 years of age or older; (3) publication between 1970 
and 2009; (4) a report in the English language; and (5) 
random assignment of at least five participants each to 
medication and placebo groups. The details of inclu- 
sion/exclusion criteria can be found in Maisel et al. ls 

Searches were intermittent due to sporadic availability 
of funds and resources. For example, in one search we 
used search terms for various medications (eg, 'naltrex- 
one'), terms for alcohol problems and use disorders and 
alcohol misuse (eg, 'alcohol*,' 'problem drinking') and 
terms for RCTs (eg, 'randomised controlled,' 'clinical 
trial'). This search yielded 1602 potential research 
reports. Based on the examination of abstracts and, in 
some cases, full-text versions of these reports, 1184 were 
identified as not relevant (eg, qualitative studies, 
reviews). Of the remaining articles, 215 were rejected 
based on not meeting our eligibility criteria (eg, open- 
label trial), 138 met the inclusion criteria, but 65 were 
additional publications for studies already in the dataset 
(eg, reporting secondary analyses). In addition to the 
database searches, we perused the reference sections 
from the reports of the included studies and from previ- 
ously published reviews of this literature. For the present 
analysis, a total of 165 studies met our inclusion criteria. 

Variables 

Descriptive and inferential statistics were generated for 
two categorical variables: (1) sample analysed and 
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(2) missing data strategy. The categories of the 'sample 
analysed' variable were 

1. Full random sample — analyses involved the total ran- 
domised N's (with or without imputation or interpol- 
ation of missing data) . 

2. Full random sample (likely) — analyses appeared to 
use the full randomised sample, but N's were not 
reported. 

3. Random sample followed up — attempted to follow-up 
all randomised participants regardless of the amount 
of medication/treatment completed and conducted 
analyses on this sample. Note there is no overlap 
between categories 1 ('full random sample') or 2 
('full random sample (likely)') and 'random sample 
followed up'. 

4. Sufficient dose — analyses were conducted for only 
those participants who completed a specified amount 
of treatment or who received at least a minimum 
dose of treatment. 

5. Completer sample — analyses conducted for only 
those patients who completed the medication/treat- 
ment phase. 

6. False inclusion — after randomisation, participants 
were found to not meet the inclusion criteria and 
were subsequently removed from the analyses. 

7. Other — reported N's or degrees of freedom that 
were less than what would be expected for the rando- 
mised N, but no explanation of the participants 
included or excluded from the analysis was provided. 

8. Unclear — insufficient information was provided to 
determine the sample analysed. 

Only analyses conducted on the full random sample 
or full random sample (likely) categories were deemed 
to be 'true' ITT analyses, whereas the others were con- 
sidered to be something other than ITT analyses. 

The categories for the 'missing data strategy' variable 
were as follows 

1. No dropout — no dropout from treatment and 100% 
reassessed. 

2. All followed — there were dropouts from treatment, 
but all participants, including treatment dropouts, 
were reassessed. 

3. Statistical interpolation — used a statistical analysis 
that interpolated missing data, for example, mixed 
effects model interpolation. 

4. Failure assumed for missing data (missing=failure) — 
assumed that missing data reflected poor outcome, 
for example, relapse. 

5. Baseline assigned — a participant's baseline score was 
assigned if outcome data were missing. 

6. Last observation carried forward (LOCF) — used the 
imputation strategy of LOCF. 

7. Censored — last assessment point was used in survival 
analyses. 

8. Mean — used the mean of the sample followed for 
missing data. 

9. Other — used some other imputation of missing data 
strategy. 



10. Sample followed — conducted analyses with data for 
the sample of participants that the researchers were 
able to follow/ reassess. 

1 1 . Unclear — no or unclear information provided. 

Statistical analyses 

Descriptive statistics were generated for data analytic 
strategies and missing data strategies used in the 165 
RCTs of pharmacotherapies for AUD and alcohol 
misuse. Generalised linear model analyses were con- 
ducted to determine changes in data analytic and 
missing data strategies over time. In those analyses, the 
response variables, data analytic strategy and missing 
data strategy were coded as binary (0='No', l='Yes'), with 
the year of publication as predictor of a 'Yes' response. 

RESULTS 

As noted in table 1, a substantial discrepancy was 
evident between reporting an ITT strategy versus actually 
conducting a 'true' ITT analysis (ie, reporting an ITT 
strategy when something other than ITT was con- 
ducted). Of the 165 studies included in this review, 74 
reported using an ITT strategy. However, less than half 
of those studies conducted a true ITT analysis (K=29; 
39%) according to information in study reports. 
Interestingly, 35% (K=32) of the 91 studies whose 
reports made no claim of using an ITT strategy, in fact, 
did perform true ITT analyses. 

Regarding the specific data analytic strategy used, the 
values in each row of table 1 do not sum to the total 
number of studies in the first column (ie, 'Reported 
Using ITT') due to the 45 studies utilising ITT and 
non-ITT analyses (eg, conducted an ITT analysis assum- 
ing failure for dichotomous outcomes and also used a 
complete cases approach for continuous outcomes). In 
such instances, we coded 'Reported Using ITT' as 'Yes' 
if the study mentioned using an ITT strategy and coded 
it as 'No' otherwise (ie, no mention of using an ITT 
strategy) . 

The most common approach utilised in studies report- 
ing the use of an ITT strategy, other than use of a true 
ITT (K=29; 39%), involved analyses of data for partici- 
pants who completed a 'sufficient dose' of the medica- 
tion/treatment (K=40; 39%). All other strategies were 
utilised <10% of the time. The most common analytic 
method used in studies not mentioning an ITT strategy 
was actually a true ITT analysis (K=32; 29%), followed by 
analyses of data from completer samples (K=31; 28%), 
analyses for participants who completed a 'sufficient 
dose' of medication/ treatment (K=19; 17%) and inde- 
terminable strategies (ie, Unclear; K=16; 14%). 

Table 2 reports the descriptive information on the 
missing data strategies employed in the studies using 
and not using a true ITT approach. Similar to table 1, 
the values in each row of table 2 do not sum to the total 
number of studies in the first column (ie, 'Conducted 
ITT') due to 42 studies utilising multiple missing data 
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Table 1 Reported versus actual intention-to-treat practices 



Sample analysed 



Reported 
using ITT 



Conducted 
true ITT* 



Full 

random 
sample 



Full random 

sample 

(likely) 



Random 
sample FU 



Sufficient 
dose 



Completer 
sample 



False 
inclusion 



Other Unclear 



Total number of ITT 

and/or non-ITT approaches used 



No (K=91) 
Yes (K=74) 
Total (K=165) 



32 (35%) 
29 (39%) 
61 (37%) 



28 (25%) 
21 (21%) 
49 (23%) 



4 (4%) 
9 (9%) 
13(6%) 



6 (5%) 

7 (7%) 
13(6%) 



19 (17%) 
40 (39%) 
59 (28%) 



31 (28%) 

7 (7%) 
38 (18%) 



2 (2%) 
8 (8%) 
10 (5%) 



4 (4%) 
2 (2%) 
6 (3%) 



16 (14%) 
0 (0%) 
16 (8%) 



112 
102 
214* 



*ITT is the full random sample or full random sample (likely) categories; K is the study, column description: (1) full random sample (analyses involved the total randomised N's), (2) full random sample 
(likely; appears to be using the full randomised sample, but N's are not reported with analyses), (3) random sample followed up (attempted to follow-up all randomised participants regardless of the 
amount of medication/treatment completed, and conducted analyses on this sample), (4) sufficient dose (analyses conducted on only those participants who received a minimum amount of 
medication/treatment), (5) completer sample (analyses conducted on only those patients who completed the medication/treatment phase), (6) false inclusion (after randomisation, participant is found to 
not meet the inclusion criteria and is subsequently removed from the analyses), (7) other (analyses report N's or degrees of freedom that are less than what would be expected for the randomised N, 
but no explanation on the participants included or excluded from the analysis is provided) and (8) unclear (insufficient information to determine the sample analysed). Only categories (1) full random 
sample and (2) full random sample (likely) are considered a 'true' ITT strategy, whereas the others are considered something other than ITT. 

*The values in each row of table 1 do not sum to the total number of studies in the first column (ie, 'Reported Using ITT") due to the 45 studies utilizing ITT and non-ITT analyses (eg, conducted an ITT 
analysis assuming failure for dichotomous outcomes and also used a complete cases approach for continuous outcomes). 
ITT, intention to treat. 



fable 2 Missing data strategies for intention-to-treat and other analytic practices 



Missing data strategy 



Conducted 
true ITT 



No tx or 
FU 

dropout 



All FU 

(some tx 
dropout) 



Interpolation Missing=failure 



Baseline 
assigned 



LOCF 



Censored 
(end of FU) 
survival Mean 
analysis substituted 



Other Sample FU Unclear 



Total number 
of ITT and/or 
non-ITT 
approaches 
used 



No (K=104) 
Yes (K=61) 
Total (K=165) 



0 

1 (1%) 
1 (<1%) 



0 

2 (2%) 
2 (<1%) 



6 (4%) 
14 (13%) 
20 (7%) 



23 (17%) 
14 (13%) 
37 (16%) 



1 0%) 

1 (1%) 

2 (<1%) 



22 (16%) 
12 (11%) 
34 (13%) 



25 (18%) 
23 (22%) 
48 (19%) 



3 (2%) 
2 (2%) 
5 (2%) 



2 (1%) 

1 0%) 

3 (1%) 



38 (27%) 
11 (10%) 
49 (19%) 



17(12%) 139 
24(23%) 105 
41 (16%) 259* 



Column description: (1) no treatment (tx) or follow-up (FU) dropout, (2) All followed up (some dropout; there were dropouts from treatment, but all participants, including dropouts were followed 
up), (3) interpolation (used a statistical analysis that interpolated missing data, eg, mixed effects model interpolation), (4) missing= failure (assumed that missing data=failure, eg, relapse), (5) 
baseline assigned (assigned a person's baseline score if the outcome score was missing), (6) LOCF (used an imputation strategy of last observation carried forward), (7) censored (end of FU; 
data presented in a survival analysis), (8) mean substituted (used the mean for each person across available assessments/timepoints), (9) other (other imputation strategy), (10) sample FU 
(conducted analyses on the sample of participants that the researchers was able to follow-up) and (11) unclear (no information provided/unclear). 

*The values in each row of table 2 do not sum to the total number of studies in the first column (ie, 'Conducted ITT) due to 42 studies utilizing multiple missing data strategies. 
FU, follow up; ITT, intention-to-treat; LOCF, last observation carried forward; tx, treatment. 
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strategies. The most common missing data strategy uti- 
lised in studies employing an ITT approach was either 
unclear (K=24; 23%) or involved censoring data at the 
end of the follow-up (FU) procedure in survival analyses 
(K=23; 22%). A study could be categorised as employing 
an ITT strategy but having an unclear missing data strat- 
egy if, for example, the study reported the full rando- 
mised N's from analyses, but it was unclear what 
particular missing data strategy was utilised. The next 
most frequently used strategies were assuming missing 
equals relapse or some other poor outcome ('Failure'; 
K=14; 13%) and using a statistical interpolation strategy 
(K=14; 13%), such as a mixed effects model. All other 
missing data strategies were utilised <10% of the time, 
except the LOCF procedure that was used in (K=12) 
11% of the studies. 

The most common missing data method utilised in 
studies not conducting a true ITT analysis was analysing 
the sample followed up (K=38; 27%), followed by cen- 
soring at the end of the FU procedure (K=25; 18%), 
assuming failure ('Failure'; K=23; 17%), LOCF (K=23; 
16%) and an unclear strategy (K=17; 12%). All other 
missing data strategies were used <10% of the time. A 
study could be categorised as not employing an ITT strat- 
egy, but still using a missing data strategy of assuming 
failure or LOCF if, for example, the study assumed 
failure for missing participants, but something less than 
the full randomised N's was reported for analyses. 
Tables 3 and 4 display changes in ITT analyses and 
missing data strategies over time. No statistically signifi- 
cant change (although a marginally significant trend) 
was found in the use of true ITT analyses over time 
(table 3). This relationship is depicted graphically with 
time on the x-axis, probability (of being an ITT) from 
generalised linear model results on the y-axis, and raw 
study values (0, not ITT; 1, ITT) displayed as points. 
The 95% CIs are displayed as a grey line around the 
probability slope. 

Several statistically significant relationships between 
missing data strategy and time emerged, as displayed in 
table 4. Specifically, censored at the end of FU (for sur- 
vival analyses), LOCF, and using a statistical analysis to 
interpolate missing data (interpolation, eg, mixed effects 
model interpolation) have become more common over 
time, whereas analyses conducted on only the samples 
of participants that the researchers were able to 
follow-up (sample FU) have become less common. To 
explore whether increasing use of certain missing data 
strategies over time was confounded with longitudinal 
methods being increasingly employed, a proxy dummy 
control variable (0, only end-of-treatment assessment; 1, 
post-treatment and follow-up assessment (s)) was added 
to the analyses; the results were virtually unchanged. 

DISCUSSION 

Across the 165 pharmacotherapy trials included in this 
analysis, less than half of the 74 studies reporting to 



Table 3 Change in true intention-to-treat (ITT) analyses 
over time 





Estimate 


SE 


t Value 


p Value 


(Intercept) 


-1.52 


0.64 


-2.39 


0.02* 


Year 


0.04 


0.02 


1.85 


0.06 



Generalised linear model with binary outcome (ITT analyses 
conducted=1 or not=0). 
*p<0.05, k=165. 

have used an ITT strategy actually did so. This finding 
probably is due, at least in part, to a lack of consensual 
definition of what constitutes an ITT analysis. In fact, the 
most common procedure for studies reporting, but not 
actually using, an ITT involved analyses on participants 
who completed a sufficient dose of treatment. That is, 
analyses were conducted on data for only those partici- 
pants who completed a certain amount of treatment or 
who received a minimum intervention. This type of ana- 
lysis is generally considered a 'per protocol' approach, 
which is in contrast to an ITT approach which includes 
outcome data for all participants, regardless of adher- 
ence to treatment. 2 

Among the studies conducting a true ITT strategy, it 
was unclear what missing data strategy was used in 
nearly 25% of these studies. Lack of clarity in journal 
articles about how missing data were handled makes it 
difficult for readers to critically assess the study findings. 
A per protocol analysis answers questions of an explana- 
tory nature, for example, 'how efficacious is this treat- 
ment for those adherent to the treatment?' In contrast, 
an ITT analysis provides more realistic (and usually less 
biased) estimates of the average treatment effects in the 
'real world,' as it accounts for patient dropout and 
non-adherence to treatment. If the findings from a per 
protocol analysis are incorrectly perceived as coming 
from an ITT analysis, the treatment effects under more 
routine conditions of care will be overestimated. Journal 
editors and peer reviewers should be attentive to these 



Table 4 Change in missing data strategy over time 




Estimate SE z Value p Value 



Fail 


0.03 


0.02 


1.38 


0.16 


All FU 


-0.10 


0.09 


-1.18 


0.24 


All FU (some dropout) 


-0.09 


0.06 


-1.43 


0.15 


Baseline assigned 


0.47 


0.36 


1.31 


0.19 


Censored (end of FU) 


0.09 


0.03 


3.19 


<0.01* 


LOCF 


0.06 


0.03 


2.01 


0.045* 


Group average 


0.07 


0.12 


0.62 


0.54 


Mean FU points 


0.07 


0.07 


0.92 


0.36 


Other 


0.05 


0.09 


0.55 


0.59 


Sample FU 


-0.10 


0.02 


-4.40 


<0.001* 


Interpolation 


0.33 


0.09 


3.83 


<0.001* 


Unclear 


0.02 


0.02 


0.94 


0.35 



Generalised linear model with binary outcome. 
*p<0.05. 

LOCF, last observation carried forward. 



Del Re AC, Maisel NC, Blodgett JC, etal. BMJ Open 201 3;3:e003464. doi:1 0.1 136/bmjopen-201 3-003464 



5 



Open Access 



issues and request that authors provide a clear descrip- 
tion of the sample analysed (ie, ITT, modified ITT or 
per protocol) in their studies, along with details regard- 
ing how missing data were handled. 

Since missing data strategies are becoming more 
sophisticated and are being facilitated by computer tech- 
nology that is easily able to process data using complex 
algorithms, the diversity of missing data strategies that 
are employed is increasing. Indeed, our findings indi- 
cate that more complex imputation or interpolation pro- 
cedures are becoming more prevalent over time. One 
such imputation procedure is multiple imputation, 3 
which involves a Bayesian estimation procedure to 
average outcomes across multiple imputed datasets. 
Missing data are then replaced with a probable value 
based on other available variables in the data. 
Presumably, the results with this approach more closely 
approximate the results of an ITT analysis with 100% 
follow-up than any other method of handling missing 
data that is currently available. 

CONCLUSION 

Discrepancies in reporting versus actually conducting 
true ITT analyses were apparent in this body of alcohol 
pharmacotherapy trials. Lack of clarity regarding the 
missing data strategy used was also common. The degree 
to which these problems are present in reports of trials 
of pharmacotherapies and psychosocial interventions for 
other conditions remains to be determined. In addition, 
consensus on a standard definition of ITT is needed, as 
are clearer reporting standards for analyses and the 
handling of missing data in reports of clinical trials. 

Contributors ACD was involved in the study design, analysis and 
interpretation of data, drafting the article and revising it. NCM was involved in 
the study design and revising the article. JCB was involved in the study 
design. JWF was involved in the study conception and design, interpretation 
of data and revising it critically for important intellectual content. All authors 
gave final approval of the version to be published. 

Funding The preparation of this manuscript was supported by the US National 
Institute on Alcohol Abuse and Alcoholism Grant No. AA008689, and the US 
Department of Veterans Affairs, Office of Research and Development, Health 



Services Research and Development Service and Substance Use Disorder Quality 
Enhancement Research Initiative funded this research. The views expressed are 
those of the authors and do not necessarily represent the views of the National 
Institute on Alcohol Abuse and Alcoholism, the Department of Veterans Affairs, 
or any other U.S. Government entity. 

Competing interests None. 

Provenance and peer review Not commissioned; externally peer reviewed. 

Data sharing statement No additional data are available. 

Open Access This is an Open Access article distributed in accordance with 
the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, 
which permits others to distribute, remix, adapt, build upon this work non- 
commercially, and license their derivative works on different terms, provided 
the original work is properly cited and the use is non-commercial. See: http:// 
creativecommons.org/licenses/by-nc/3.0/ 



REFERENCES 

1 . Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res 
2011;2:109-12. 

2. Hollis S, Campbell F. What is meant by intention to treat analysis? 
Survey of published randomised controlled trials. BMJ 1 999;31 9:670-4. 

3. Little RJ, Rubin DB. Statistical analysis with missing data. Wiley 
New York, 1987. 

4. Ruiz-Canela M, Martinez-Gonzalez MA, de Irala-Estevez J. Intention 
to treat analysis is related to methodological quality. BMJ 
2000;320:1007. 

5. Moher D, Schulz K, Altman D. The CONSORT statement: revised 
recommendations for improving the quality of reports of parallel 
group randomized trials. BMC Med Res Methodol 2001 ;1 :2. 

6. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: 
updated guidelines for reporting parallel group randomised trials. Int 
J Surg. Published Online First: 201 1 . http://www.sciencedirect.com/ 
science/article/pii/S1 74391 91 1 1005620 (accessed 6 Mar 2013). 

7. Zwarenstein M, Treweek S, Gagnier JJ, etal. Improving the reporting 
of pragmatic trials: an extension of the CONSORT statement. BMJ. 
Published Online First: 2008. http://www.ncbi.nlm.nih.gov/pmc/ 
articles/PMC3266844/ (accessed 6 Mar 2013). 

8. Polit DF, Gillespie BM. Intention-to-treat in randomized controlled 
trials: recommendations for a total trial strategy. Res Nurs Health 
2010;33:355-68. 

9. Schulz KF, Grimes DA. Sample size slippages in randomised trials: 
exclusions and the lost and wayward. Lancet 2002;359:781-5. 

10. Avins AL, Pressman A, Ackerson L, etal. Placebo adherence and its 
association with morbidity and mortality in the studies of left 
ventricular dysfunction. J Gen Intern Metf 2010;25:1275-81. 

1 1 . Granger AL, Fehnel SE, Hogue SL, et al. An assessment of patient 
preference and adherence to treatment with Wellbutrin SR: a 
web-based survey. J Affect Disord 2006;90:21 7-21 . 

12. Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in 
therapeutical trials. J Clin Epidemiol 2009;62:499-505. 

13. Maisel NC, Blodgett JC, Wilbourne PL, etal. Meta-analysis of 
naltrexone and acamprosate for treating alcohol use disorders: when 
are these medications most helpful? Addiction 2013;108:275-93. 



6 



Del Re AC, Maisel NC, Blodgett JC, etal. BMJ Open 201 3;3:e003464. doi:1 0.1 1 36/bmjopen-201 3-003464 



